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(57) ABSTRACT 

The invention provides for the automation of a multiple 
camera system based upon the location of a target object in 
a displayed camera image. The preferred system provides a 
nearly continuous display of a figure as the figiu*e moves 
about throughout multiple cameras' potential fields of view. 
When the figure approaches the bounds of a selected cam- 
era's field of view, the system determines which other 
camera's potential field of view contains the figure, and 
adjusts that other camera's actual field of view to contain the 
figure. When the figure is at the bounds of the selected 
camera's field of view, the system automatically selects the 
other camera. The system also contains predictive location 
determination algorithms. By assessing the movement of the 
figure, the system selects and adjusts the next camera based 
upon the predicted subsequent location of the figure. 

18 Claims, 9 Drawing Sheets 
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AUTOMATED CAMERA HANDOFF SYSTEM 
FOR FIGURE TRACKING IN A MULTIPLE 
CAMERA SYSTEM 

BACKGROUND OF THE INVENTION 5 

1. Field of the Invention 

This invention relates to a system for controlling multiple 
video cameras. This invention allows for an automated 
camera handoff for selecting and directing cameras within a 
multi-camera system, as might be used in a security system 
or a multi-camera broadcasting system. The automation is 
provided by tracking a figure within the image from an 
individual camera, coupled with an area representation of 
the fields of view of each of the other cameras. 15 

2. Description of Related Art 

Security systems for airports, casinos, and the like typi- 
cally employ a multitude of cameras that provide images of 
selected areas to a control station. The images from each of 
these cameras, or a subset of these cameras, are displayed on 20 
one or more monitors at the control station. The operator of 
the control station is provided an ability to select any one of 
the cameras for a display of its image on a primary monitor, 
and, if the camera is adjustable, to control of the camera's 
field of view. Such control systems are also utilized for 25 
selecting from among multiple cameras at an event being 
broadcast, for example, multiple cameras at a sports arena, 
or studio. 

The selection and control of the cameras is typically 
accomplished by controlling a bank of switches, or by 
selecting from amongst a list of cameras on a computer 
terminal. To view a particular area, the operator selects the 
camera associated with that area. If the camera is adjustable, 
the operator subsequently adjusts the selected camera's field 
of view by adjusting its rotation about a horizontal axis (pan) 
or vertical axis (tilt), or its magnification (zoom). The entire 
span of an adjustable camera's span of view is termed herein 
as the camera's potential field of view, whereas the view 
resulting from the particular pan, tilt, and zoom settings is 
termed the camera's actual field of view. ^ 

Image processing algorithms are available which allow 
for the identification of a particular pattern, or figure, within 
an image, and the identification of any subsequent move- 
ment of that figure. Coupled with a security control system, 
such image processing algorithms allow for the automated 
adjustment of a camera so as to keep the figure in the center 
of the cameras actual field of view. When the figure travels 
beyond the potential field of view of the camera, the operator 
selects another camera whose potential field of view con- 
tains the figure at its new location, adjusts the camera, 
identifies the figure in the camera's actual field of view, and 
thereafter continues the automated tracking until the figure 
exits that camera's potential field of view. 

In the conventional camera selection scenario, the opera- 55 
tor must be familiar with the layout of the secured area, as 
well as the correspondence between the displayed image and 
this layout. That is, for example, if a figure is seen exiting 
through one of several doorways, the operator must be able 
to quickly determine to which other area that particular gQ 
doorway leads, and must further determine which camera 
includes that other area. 

SUMMARY OF THE INVENTION 

It is an object of this invention to provide for the auto- 65 
mation of a multiple camera system, so as to provide for a 
multi-camera figure tracking capability. The preferred sys- 
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tem will allow for the near continuous display of a figure as 
the figure moves about throughout the multiple cameras' 
potential fields of view. 

The approximate physical location of a figure is deter- 
mined from the displayed image, the identification of the 
figure within this image by the figure tracking system, and 
a knowledge of the camera's location and aaual field of 
view which is producing the displayed image. If the figure 
exits a selected camera's field of view, another camera 
containing the figure within its field of view is selected. The 
bounds of each camera's potential field of view are con- 
tained in the system. The system determines which cameras' 
potential fields of view contain the figure by determining 
whether the figure's determined physical location lies within 
the bounds of each camera's field of view. 

In a preferred embodiment, when the figure approaches 
the bounds of the selected camera's potential field of view, 
the system determines which other camera's potential field 
of view contains the figure, then adjusts that other camera's 
actual field of view to contain the figure. When the figure is 
at the bounds of the selected camera's field of view, the 
system automatically selects an other camera and commu- 
nicates the appropriate information to the figure tracking 
process to continue the tracking of the figure using this other 
camera. 

In a further embodiment of the invention, the system also 
contains predictive location determination algorithms. By 
assessing the movement of the figure, the selection and 
adjustment of the next camera can be effected based upon 
the predicted subsequent location of the figure. Such pre- 
dictive techniques are effective for tracking a figure in a 
secured area in which the cameras' fields of view are not 
necessarily overlapping, and also for selecting from among 
multiple cameras containing the figure in their potential field 
of view. 

By associating the dii^layed image to the physical locale 
of the secured area, the operator need not determine the 
potential egress points from each camera's field of view, nor 
need the operator know which camera or cameras cover a 
given area, nor which areas are adjacent each other. 

In another embodiment, the seleaion of a target is also 
automated. Security systems often automatically select a 
camera associated with an alarm, for the presentation of a 
view of the alarmed area to the operator. By associating a 
target point with each alarm, for example the entry way of 
a door having an alarm, the system can automatically select 
and adjust the camera associated with the alarm to contain 
that target point, and identify the target as those portions of 
the image which exhibit movement. Thereafter, the system 
will track the target, as discussed above. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 illustrates an example multi-camera security sys- 
tem in accordance with this invention. 

FIG. 2 illustrates an example graphic representation of a 
secured area with a multi-camera security system, in accor- 
dance with this invention. 

FIGS. 3fl, 3b and 3c illustrate example field of view 
polygons associated with cameras in a multi-camera security 
system, in accordance with this invention. 

FIG. 4 illustrates an example three dimensional represen- 
tation of a secured area and a camera's field of view 
polyhedron, in accordance with this invention. 

FIGS. 5fl, Sh and 5c illustrate an example of the associa- 
tion between a figure in an image from a camera and the 
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physical representation of the secured area, in accordance the location detertninator 140. In FIG, 2, line segments PI 

with this invention, through P5 represent the path of a person (not shown) 

FIGS. 6a and 6b illustrate example flowcharts for the traversing the secured areas. The operator of the security 

automated camera handoff process in accordance with this system, upon detecting the figure of the person in the image 
invention. 5 of camera 105, identifies the figure to the figure tracking 

DESCRIFnON OF THE PREFERRED f^^'eo. mtypica^^^^^^ 

PMttnnTMPMT^ image from camera 1U5 on the video screen 180. 

Alternatively, automated means can be employed to identify 

FIG. 1 illustrates a multi-camera security system. The moving objects in an image that conform to a particular 
system comprises video cameras 101, 102, 103 and 104^106 target profile, such as size, shape, speed, etc. Camera 105 is 
(shown in FIG. 2). Cameras 101 and 102 are shown as initially adjusted to capture the figure, and the figure track- 
adjustable, pan/tilt/zoom, cameras. The cameras 101. 102, jng techniques continually monitor and report the location of 
103 provide an input to a camera handoff system 120; the the figure in the image produced from camera 105. The 
connections between the cameras 101, 102, 103 and the figure tracking system 144 associates the characteristics of 
camera handoff system 120 may be direct or remote, for the selected area, such as color combinations and patterns, to 
example, via a telephone connection. In accordance with this the idendfied figure, or target. Thereafter, the figure tracking 
invention, the camera handoff system 120 includes a con- system 144 determines the subsequent location of this same 
troller 130, a location determinator 140, and a field of view characteristic pattern, corresponding to the movement of the 
determinator 150. The controller 130 effects the control of identified target as it moves about the camera's field of view, 
the cameras 101, 102, 103 based on inputs from the sensors Manual figure tracking by the operator may be used in 
111, 112, the operator station 170, and the location deter- addition to, or in lieu of, the automated figure tracking 
minator 140 and field of view determinator 150. system 144. In a busy scene, the operator may be better able 

An operator controls the security system via an operator's to distinguish the target. In a manual figure tracking mode, 

station 170, and controller 130. 'IJe_op^rato£ typically the operator uses a mouse or other suitable input device to 

selects from^tions presented on a screen 180 tO:seIecl one point to the target as it traverses the image on the display 

^of.the^cameras^lOl* 103, and controls the selected 180. 

camera^oT^hange -its 4ine_ of~sight,^^^ If camera 105 is adjustable, the controller 130 adjusts 

adjustments, ormagiiification;factor,M^ camera 105 to maintain the target figure in the center of the 

The image from the "selected camera's field of view is image from camera 105. That is, camera 105's line of sight 

presented to the operator for viewing via the switch 135. and actual field of view will be adjusted to continue to 

The optional alarm sensors HI, 112 provide for automatic contain the figure as the person moves along path PI within 

camera selection when an alarm condition is sensed. Each camera 105's potential field of view. Soon after the person 

alarm sensor has one or more cameras associated with it; progresses along path P2, the person will no longer be within 

when the alarm is activated, an associated camera is selected camera 105 's potential field of view, 
and adjusted to a predefined line of sight and the view is 35 Iq accordance with this invention, based upon the dcter- 

displayed on the screen 180 for the operator's further ^jined location of the person and the determined field of 

assessment and subsequent security actions. view of each camera, the controller 130 selects camera 106 

The field of view determinator 4^0 detennines the field of when the person enters camera 106's potential field of view, 

view of each camera based upon4tsl^tipn3and orientation. In a preferred embodiment that includes a figure tracking 
Non-adjustable camera 103 has a fixed field of view, 40 system 144, the figure tracking techniques will subsequently 

whereas the adjustable cameras 101. 102 each have varying be applied to continue to track the figure in the image from 

fields of view, depending3u^n^the-current^panr^tilt,^and camera 106. Similarly, the system in accordance with this 

zoom settingsjaf Ihejcabnera. To facilitate the determination invention will select camera 103, then camera 102, then 

of "each'camera's field of view, the camera handoff system camera 104, and then camera 102 again, as the person 
120 includes a database 160 that describes the secured area 45 proceeds along the P3-P4-P5 path. 

and the location of each camera. The database 160 may Jq effect this automatic selection of cameras, the camera 
include a graphic representation of the secured area, for handoff system 120 includes a representation of each cam- 
example, a floor plan as shown in FIG. 2. The floor plan is era's location and potential field of view, relative to each 
created and entered in the control system when the security other. For consistency, the camera locations are provided 
system is installed, using for example Computer Aided 50 relative to the site plan of the secured area that is contained 
Design (CAD) techniques well known to one skilled in the in the secured area database 160. Associated with each 
art. Each wall and obstruction is shown, as well as the camera is a polygon or polyhedron, outlining each camera's 
location of each of ^l e^mer as IPl^^- potential field of view. FIG, 3a illustrates the polygon 

The location dcte^nM^140^iBSiielIhelocalion.of associated with camera 102. FIG. 3i> illustrates the polygon 
anjO^cct-withm a^selectcd^^m^ Based 55 associated with camera 103, Camera 102 is a camera having 

upon the^bject's location within the image from the an adjustable field of view, and thus can view any area 

selected camera, and the camera's physical location and within a full 360 degree arc, provided that it is not blocked 

orientation within the secured area, the location determina- by an obstruction. Camera 103 is a camera with a fixed field 

tor 140 determines the object's physical location within the of view, as represented by the limited view angle 203. 
secured area. The controller 130 determines which cameras* 60 Camera 102 's potential field of view is the polygon bounded 

field of view include the object's physical location and by vertices 221 through 229. Camera 103's field of view is 

selects the appropriate camera when the object traverses the polygon bounded by vertices 230-239. As shown, the 

from one camera's field of view to another camera's field of field of view polygon can include details such as the ability 

view. The switching from one camera to anodier is termed to see through passages in obstructions, such as shown by 
a camera handoff. 65 the vertices 238 and 239 in FIG. 36. Also associated with 

In a preferred embodiment, the camera handoff is further each camera is the location of the camera, shown for 

automated via the use of figure tracking system 144 within example as 220, 230, 240 in FIGS, 3a, 36, 3c. The polygon 
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representing the field of view of camera 104 is shown in 
FIG. 3c, comprising vertices 240 through 256. As shown in 
FIG. 3c, the field of view polygon can omit details, as shown 
by the use of vertices 244-245, onaitting the actual field of 
view vertices 264-265. The level of detail of the polygons 
is relatively arbitrary; typically, one would provide the detail 
necessary to cover the maximum surveillance area within 
the secured area. If one area is coverable by multiple 
cameras, the need is minimal for identifying the fact that a 
particular camera can also view that area by viewing through 
a doorway. Conversely, if the only view of an area is through 
such a doorway, the encoding of the polygon to include this 
otherwise uncovered area may be worthwhile. Similarly, 
although an unobstructed view of a camera is infinite, 
polygon bounds can be defined to merely include the area of 
interest, as shown for example in FIG. 3c, where the bounds 
249-250 and 253-254 are drawn just beyond the perimeter 
of the area being secured. 

The site map may also be represented as a three dimen- 
sional model, as shown in FIG. 4. In a three dimensional 
model, the cameras* fields of view are represented by 
polyhedron, to include the three-dimensional nature of a 
camera's field of view. The polyhedron associated with 
camera 104 is shown in FIG. 4, and is represented by the 
vertices 441 through 462. As discussed above, the detail of 
the polyhedron model is dependent upon the level of pre- 
cision desired. For example, vertices 449 through 454 model 
the view through the portal 480 as a wedge shaped area, 
whereas vertices 455 through 462 model the view through 
the portal 481 as a block shaped area. Three dimensional 
modeling will provide for greater flexibility and accuiracy in 
the determination of actual location of the target, but at 
increased computational costs. For ease of understanding, 
two dimensional modeling will be discussed hereafter. The 
techniques employed are equally applicable to three dimen- 
sional site maps, as would be evident to one skilled in the art. 

The coordinate system utilized for encoding the camera 
locations and orientations can be any convenient form. 
Actual dimensions, relative to a reference such as the floor 
plan, may be used; or, scaled dimensions, such as screen 
coordinates may be used. Techniques for converting firom 
one coordinate system to another are well known to one 
skilled in the art, and different coordinate systems may be 
utilized as required. Combinations of three dimensional 
modehng and two dimensional modeling may also be 
employed, wherein for example, the cameras at each floor of 
a multistoried building are represented by a two dimensional 
plan, and each of these two dimensional plans have a third, 
elevation, dimension associated with it. In this manner, the 
computationally complex process of associating an image to 
a physical locale can operate in the two dimensional 
representation, and the third dimension need only be pro- 
cessed when the target enters an elevator or stairway. 

FIGS. 5a-5c demonstrates the association of a figure in an 
image to a target in the physical coordinate system, in 
accordance with this invention. An image 510 from camera 
502 (shown in FIG. 5c), containing a figure 511, is shown in 
FIG, 5a. As discussed above, figure tracking processes are 
available that determine a figure's location within an image 
and allows a camera control system to adjust camera 502 's 
line of sight so as to center the figure in the image, as shown 
in FIG. Sb. The controUer 130 in accordance with this 
invention will maintain the camera 502*s actual line of sight, 
in terms of the physical site plan, for subsequent processing. 
If the camera is not adjtistable, the line of sight from the 
camera to the figure is determined by the angular distance 
the figure is offset from the center of the image. By adjusting 
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the camera to center the figure, a greater degree of accuracy 
can be achieved in resolving the acmal line of sight to the 
figure. With either an adjustable or non adjustable camera, 
the direction of the target from the camera, in relation to the 

5 physical site plain, can thus be determined. For ease of 
understanding, the Hne of sight is used herein as the straight 
fine between the camera and the target in the physical 
coordinate site plan, independent of whether the camera is 
adjusted to effect this line of sight. 

10 FIG. 5c illustrates the physical representation of a seciu-ed 
area, as well as the location of camera 502, the line of sight 
580 to the target, and the camera's actual field of view, as 
bounded by rays 581 and 582 about an angle of view 585. 

To determine the precise location of the target along the 
line of sight 580, two alternative techniques can be 
employed: triangulation and ranging. In triangulation, if the 
target is along the line of sight of another camera, the 
intersection of the lines of sight will determine the target's 
actual location along these lines of sight. This triangulation 
method, however, requires that the target he within the field 
of view of two or more cameras. Alternatively, with auto- 
focus techniques being readily available, the target's dis- 
tance (range) from the camera can be determined by the 
setting of the focus adjustment to bring the target into focus. 
Because the distance of the focal point of the camera is 
directly correlated to the adjustment of the focus control on 
the camera, the amount of focus control applied to bring the 
target into focus will provide sufficient information to esti- 
mate the distance of the target from the location of the 
camera, provided that the correlation between focus control 
and focal distance is known. Any number of known tech- 
niques can be employed for modeling the correlation 
between focus control and focal distance. Alternatively, the 
camera itself may contain the ability to report the focal 
distance, directly, to the camera handoff system. Or, the 
focal distance information may be provided based upon 
independent means, such as radar or sonar r^mging means 
associated with each camera. 

^ In the preferred embodiment, the correlation between 
focus control and focal distance is modeled as a polynomial, 
associating the angular rotation x of the focus control to the 
focal distance R as follows: 

45 

The degree n of the polynomial determines the overall 
accuracy of the range estimate. In a relatively simple system, 
a two degree polynomial (n=2) will be sufficient; in the 
preferred embodiment, a four degree polynomial (n-4) is 

50 found to provide highly accurate results. The coeflBcients ao 
through an are determined empirically. At least n+1 mea- 
surements are taken, adjusting the focus x of the camera to 
focus upon an item place at each of n+1 distances from the 
camera. Conventional least squares curve fitting techniques 

55 are applied to this set of measurements to determine the 
coeflBcients &q through a„. These measurements and curve 
fitting techniques can be applied to each camera, to deter- 
mine the particular polynomial coefficients for each camera; 
or, a single set of polynomial coefficients can be appUed to 

60 all cameras having the same auto-focus mechanism. In a 
preferred embodiment, the common single set of coefficients 
are provided as the default parameters for each camera, with 
a capabihty of subsequently modifying these coefficients via 
camera specific measurements, as required. 

65 If the camera is not adjustable, or fixed focus, alternative 
techniques can also be employed to estimate the range of the 
target firom the camera. For example, if the target to be 
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tracked can be expected to be of a given average physical a person, comprisiDg arbitrarily moving appendages and 

size, the size of the figure of the target in the image can be relatively unsharp edges, is difficult to determine absolutely, 

used to estimate the distance, using the conventional square Data smoothing techniques can be applied so as to minimize 

law correlation between image size and distance. Similarly, the jitter in the predictive location Q, whether determined 

if the camera's line of sight is set at an angle to the surface 5 using a linear or non-linear model These and other tech- 

of the secured area, the vertical location of the figure in the niqucs of motion estimation and location prediction are well 

displayed image will be correlated to the distance from the known to those skilled in the art. 

camera. These and other techniques are well known in the art Given a predicted location Q, in the site map coordinate 

for estimating an object's distance, or range, from a camera. system, the cameras containing the point Q within their 

Given the estimated distance from the camera, and the lO potential fields of view can be determined. If the predicted 

camera's position and line of sight, the target location P, in location Q hes outside the limits of the current camera's 

the site plan coordinate system, corre^onding to the figure potential field of view, an alternative camera, containing 

location in the displayed image from the camera, can be location Q in its field of view, is selected and adjusted so as 

determined. Given the target location P, the cameras within to provide the target in its actual field of view. The system 

whose fields of view the location P lies can be determined. 15 need not wait until the predicted location is do longer within 

This is because the cameras' fields of view are modeled in the cxurent camera's field of view; if the predicted location 

this same coordinate system. Additionally, the cameras Q is approaching the bounds of the selected camera's field 

whose fields of view are in proximity to the location P can of view, but well within the bounds of another camera's field 

also be determined. of view, the other camera can be selected. Similarly, the 

At option, eadi of the cameras including the target point 20 distance from each camera can be utilized in this selection 

can be automatically adjusted to center the target point in process. As is common in the art, a weighting factor can be 

their respective fields of view, independent of whether the associated with each of the parameters associated with the 

camera is selected as the camera utilized for figure tracking. viewing of a secuxity scene, such as the distance from the 

In the preferred embodiment, all cameras which contain the camera, the distance from the edge of the camera's field of 

target in their potential field of view, and which are not 25 view, the likelihood that the target will be locatable in the 

allocated to a higher priority task, are automatically redi- camera's field of view (influenced, for example, by the 

rected to contain the target in their actual field of view. complexity of image from one camera versus that from 

Note that while automated figure tracking software is another), whether this camera is currently selected, etc. 

utilized in the preferred embodiment, the techniques pre- Using these weighting factors, the preference for selecting 

sented herein are also applicable to a manual figure tracking 30 the camera can be determined, and the most preferred 

scenario as well. That is, for example, the operator points to camera can be selected and adjusted, 

a figure in the image from a camera, and the system Hereinafter, without loss of generality, target location P 

determines the line of sight and range as discussed above. will be used to identify the location to which a camera is 

Thereafter, knowing the target location, the system displays intended to be directed, regardless of whether this location 

the same target location from the other cameras, automati- 35 P is the prior location or estimated next location, 

cally. Such a manual technique would be useful, for If another camera cannot be found which contains the 

example, for managing multiple cameras in a sports event, location P, a camera with a field of view in the proximity of 

such that the operator points to a particular player, and the the location Pcan be selected, and the figure tracking system 

other cameras having this player in their field of view are 144 directed to attempt to locate the figure in the subsequent 

identified for alternative selection and/or redirection to also 40 images from this camera. To optimize the likelihood of 

include this player. success in selecting a camera that contains the figure, a 

A variety of techniques may be employed to determine variety of techniques can be employed. Each camera can 

whether to select a different camera from the one currently contain a list of those cameras having a potential field of 

selected for figure tracking, as well as techniques to select view in proximity to its potential field of view. This list 

among multiple cameras. Selection can be maintained with 45 would exclude cameras whose fields of view are in prox- 

thc camera containing the figure until the figure tracking imity to its field of view, but which fields of views are 

system 144 reports that the figure is no longer within the physically separated and inaccessible firom its field of view; 

view of that camera; at that time, one of the cameras which for example a camera in an adjacent room, to which there is 

had been determined to have contained the target in its prior no access from this camera's room. Similarly, the list could 

location P can be selected. The camera will be positioned to 50 be segregated by sub-areas within the camera's field of view, 

this location P and the figure tracking system 144 will be so as to include only those cameras having fields of view 

directed to locate the figure in the image from this camera. with direct access from each of the sub areas within the 

The assumption in this scenario is that the cameras are camera's field of view. For example, with reference to FIG. 

arranged to have overlapping fields of view, and the edges 2, cameras 102 and 103 have adjacent fields of view to 

of these fields of view are not coincident, such that the target 55 camera 104's field of view. The list associated with camera 

cannot exit the field of view of two cameras simultaneously. 104 would contain both cameras 102 and 103, but may be 

In a preferred system, rather than utilizing the prior structured such that, if the target point lies to the left of the 

location P, the camera handoff system includes an predictor middle of camera 104's potential field of view, camera 102 

142 that estimates a next location Q, based upon the motion is identified as the next camera to be utihzed; if the target lies 

(sequence of prior locations) of the figure. A linear model 60 to the right of camera 104's potential field of view, camera 

can be used, wherein the next location is equal to the prior 103 is identified as the next camera to be utilized, 

location plus the vector distance the target traveled from its In addition to explicit list and sorting techniques, common 

next-prior location. Anon-linear model can be used, wherein to those skilled in the art, Expert System approaches to the 

the next location is dependent upon multiple prior locations, identification and selection of subsequent actions can be 

so as to model both velocity and acceleration. Typically, the 65 employed. For example, given that the target is within a 

figure tracking system 144 locations exhibit jitter, or spo- particular area in the site plan, the egresses from the area can 

radic deviations, because the movement of a figxirc such as be determined from the site plan, and the most likely egress 
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identified based upon the pattern of activity of the target, or 
upon a model of likelihood factors associated with each 
egress point. For example, the route from the lobby of a bank 
to the bank's vault would have a high likelihood of use when 
the target first enters a bank. The bank exit would have a low 5 
likelihood of intended use at this time. But, these likelihoods 
would reverse once the target returns from the vault. 

FIG. 6a illustrates a flowchart for associating the position 
of a figure in an image, as reported by a figure tracking 
system, to the location of a target in the physical site plan lO 
coordinate system. FIG. 6b illustrates a flowchart for select- 
ing a camera whose field of view contains this target 
location. 

In FIG. 6a, the position of the figure within an image, and 
an identification of the camera providing this image, is 15 
provided by the figure tracking system and controller, at 610. 
Hie position of the image relative to the orientation of the 
camera determines the line of sight, LOS, from the camera 
to the target, in the physical coordinate space, at 615. The 
orientation of the camera, in the physical coordinate space, 20 
is determined when the camera is initially installed. If the 
camera is not adjustable, the direction the camera is aimed, 
in the physical domain, is the orientation of the camera. If 
the camera is adjustable, the initial orientation is determined 
by aiming the camera at a point having a known location in 25 
the physical representation of the secured site, such as a 
corner; subsequent rotations of the camera will then be 
relative to this known direction. 

To determine the location of the target along the deter- 
mined line of sight LOS, either ranging or interpolation 30 
methods may be employed, at 620. If the range method is 
used, the distance between the camera and the target is 
determined, at 624, using the methods discussed above. The 
target location P, in the physical domain, is determined, at 
628, as the point along the LOS at a distance R fi:om the 35 
camera's location. 

If a triangulatioo method is utilized, the line of sight is 
stored as LOSl, at 632, and another image is assessed by the 
target tracking system to provide a position relative to 
another camera's image, at 634. The line of sight L0S2 40 
relative to this second camera is determined, at 636. The 
target location P, in the physical domain, is determined at 
638 as the point at the intersection of the line LOSl from the 
first camera's location and the line L0S2 from the second 
camera's location. 45 

As discussed above, in the preferred embodiment, this 
target location is processed, at 640, so as to produce a 
predicted next position, or filtered to remove jitter, or a 
combination of both. The processed target location P is 
returned, at 645, for presentation to the camera selection 50 
process of FIG. 6b, 

FIG. 6b illustrates a flowchart for identifying and select- 
ing a camera containing the target point P. Given the target 
point P, in the physical domain coordinate system, at 650, 
the camera handoff system in accordance with this invention 55 
determines which cameras contain this target point in the 
loop 652-658. Because each camera's potential field of view 
is represented as vertices in the physical domain coordinate 
system, the process merely comprises a determination of 
whether point P lies within the polygon or polyhedron 60 
(CamPoly) associated with each camera. If the number of 
cameras is large, this search process can be optimized, as 
discussed above. The search process employed would 
replace this exhaustive search loop at 652-658. 

The system thereafter selects one of the cameras contain- 65 
ing the target point P in its potential field of view, at 660. As 
discussed above, a variety of techniques may be employed 
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to select from among a nimiber of cameras, typically with 
the current camera being given selection preference, to avoid 
a continual change of cameras and views. If no camera 
contains target point P, the aforementioned predictive tech- 
niques can be apphed to identify a new target point; 
alternatively, the closest camera to the target point can be 
selected. Once a camera is selected, its actual field of view 
is adjusted so as to contain the target point at the center of 
its image, at 664-668. Any changes in camera selection or 
orientation are communicated to the figure tracking system, 
at 670, and the process returns, at 675. 

In a further embodiment, the system comprises alarms, 
each alarm having an associated camera and predefined 
target point, in the physical domain coordinate system. Upon 
receipt of an alarm, at 690, the system marks the associated 
camera for selection, at 692. The target point P is set to the 
associated predefined target point, at 694, and the process 
continues, as discussed above, at 660. Optionally, the system 
could signal the figure tracking system that a new target is 
to be identified, by noting movements in proximity to this 
target point in subsequent images; or, the operator, having 
been altered to the alarm and presented the image at the 
target point, could outfine the figure directly. Thereafter, the 
system will track the figure, selecting ahernate cameras to 
maintain the tracking, as discussed above. 

For completeness, the user's ability to override the cam- 
era handoff system's selection is shown, at 680. Provided 
that the system provides a preference to select the currently 
selected camera, to minimize changing images, at 660, the 
user selected camera will thereafter be the currently selected 
camera for subsequent camera selection umtil the figure is no 
longer in the selected camera's potential field of view. 

The foregoing merely illustrates the principles of the 
invention. It will thus be appreciated that those skilled in the 
art will be able to devise various arrangements which, 
although not explicitly described or shown herein, embody 
the principles of the invention and are thus within its spirit 
and scope. 

We claim: 

1. A camera handoff system comprising: 

a location detenninator that determines a location of a 
figure that is within an image from a first camera based 
on a location and an orientation of the first camera, 

a field of view detenninator that determines a field of view 
of a second camera based on a location and an orien- 
tation of the second camera, and 

a controller, operably coupled to the location determinator 
and the field of view detenninator, said controller 
selecting the second camera based at least partially 
upon whether the location of the figure is within the 
field of view of the second camera, 

wherein the location determinator includes a predictor 
that determines a predicted location of the figure based 
on a one or more prior locations of the figure, the 
location of the figure being at least partially based on 
this predicted location. 

2. The camera handoff system of claim 1, wherein the 
controller includes: 

means for determining a target angle between the second 
camera and the location of the figure, and 

means for orienting the second camera to said target 
angle. 

3. The camera handoff system of claim 1, wherein the 
location determinator includes a figure tracking system. 

4. The camera handoff system of claim 1, wherein the 
controller includes means for selecting and orienting the first 
camera in dependence upon an alarm signal firom a sensor. 
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5. The camera handoff system of claim 1, wherein the 
selection of the second camera is also based on at least one 
of the following: 

a proximity of a field of view of the first camera with the 
field of view of the second camera; 5 

a likelihood of egress firom the field of view of the first 
camera to the field of view of the second camera; and 

obstructions between the field of view of the first camera 
and the field of view of the second camera. 

6. The camera handoff system of claim 1, wherein the 
location determinator includes: 

means for identifying an image location corresponding to 
the figure within the image from the first camera, 

means for determining a line of sight between the first is 
camera and the figure based on the image location, and 

means for determining a distance between the first camera 
and the figure; whereby the location of the figure 
corresponds to a point that is at the distance from the 
image location of the first camera along the line of 20 
sight. 

7. The camera handoff system of claim 6, wherein the 
means for identifying the image location is a figure tracking 
system. 

8. The camera handoff system of claim 7, wherein the 
controller includes means for selecting and orienting the first 
camera in dependence upon an alarm signal from a sensor. 

9. The camera handoff system of claim 8, wherein the 
controller further includes: 

means for determining a target angle between the second 

camera and the location of the figure, and 
means for orienting the second camera to this target angle. 

10. A security system for monitoring a secured area, 
comprising: 

a plurality of cameras, each camera having a location and 
field of view within the secured area, 

a monitor for viewing an image from a selected camera of 
the plurality of cameras, the selected camera having an 
orientation angle relative to the secured area, 40 

means for identifying a portion of the image as a target, 
the portion of the image corresponding to an item 
within the selected camera's field of view, the item 
having a location within the secured area, and the target 
having a location within the image, ^5 

means for determining the linear distance between the 
selected camera's location and the item's location, 

means for determining the angular distance between the 
selected camera's orientation and the item's location, in 
dependence upon the location of the target within the 
image, 

means for determining the item's location in dependence 
upon the determined linear distance and angular 
distance, relative to the camera's location, 55 

means for selecting an other camera of the plurality of 
cameras in dependence upon the determined item's 
location and the other camera's field of view within the 
secured area. 
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11. The security system of claim 10, further including: 
means for determining a target angle between the other 

camera and the location of the item, and 
means for orienting the second camera to this target angle. 

12. The camera handoff system of claim 10, wherein the 
tneans of identifying the portion of the image as the target 
includes a figure tracking system. 

13. The camera handoff system of claim 10, further 
including means for selecting and orienting the selected 
camera in dependence upon an alarm signal from a sensor. 

14. A method for selecting a second camera based on an 
image from a first camera, including the steps of: 

identifying a target figure in the image firom the first 
camera, 

determining a target location of the target figure based on 

a location and an orientation of the first camera, 
determining a field of view of the second camera based on 

a location and an orientation of the second camera, 
selecting the second camera based upon whether the 

target location is within the field of view of the second 

camera, 

identifying an image location corresponding to the target 
figure, 

determining a line of sight between the first camera and 

the target figure based on the image location, 
determining a distance between the first camera and the 

target figure, and 
determining the target location as a point that is at the 

distance from the location of the first camera along the 

line of sight. 

15. The method of claim 14, further including the steps of: 
determining a target angle between the second camera and 

the target location, and 
orienting the second camera to this target angle. 

16. The method of claim 14, wherein the step of identi- 
fying the target figure includes the steps of: 

identifying a portion of a first frame of the image as a 

target image, 
determining characteristics of the target image, and 
identifying the target figure as a portion of a second frame 

of the image that has the characteristics of the target 

image. 

17. The method of claim 14, wherein the step of identi- 
fying the target figure includes the steps of: 

identifying a portion of a first frame of the image as a 

target image, 
determining characteristics of the target image, and 
identifying the target figure as a portion of a second frame 

of the image that has the characteristics of the target 

image. 

18. The method of claim 14, further including the steps of: 
determining a target angle between the second camera and 

the location of the figure, and orienting the second 
camera to this target angle. 
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